Sizing of the Multilayer Perceptron via Modular Networks
نویسندگان
چکیده
A fast method for sizing the multilayer perceptron is proposed. The principal assumption is that a modular network with the same theoretical pattern storage as the multilayer perceptron has the same training error. This assumption is analyzed for the case of random patterns. Using several benchmark datasets, the validity of the approach is demonstrated.
منابع مشابه
Performance Analysis of Classifier Ensembles: Neural Networks Versus Nearest Neighbor Rule
We here compare the performance (predictive accuracy and processing time) of different neural network ensembles with that of nearest neighbor classifier ensembles. Concerning the connectionist models, the multilayer perceptron and the modular neural network are employed. Experiments on several real-problem data sets demonstrate a certain superiority of the nearest-neighborbased schemes, in term...
متن کاملA Modular Neural Network Architecture with Additional Generalization Abilities for High Dimensional Input Vectors
iii Abstract In this project a new modular neural network is proposed The basic building blocks of the architecture are small multilayer feedforward networks trained using the Backpropagation algorithm The structure of the modular system is similar to architectures known from logical neural networks The new network is not fully connected and therefore the number of weight connections is much le...
متن کاملDivide-and-conquer learning and modular perceptron networks
A novel modular perceptron network (MPN) and divide-and-conquer learning (DCL) schemes for the design of modular neural networks are proposed. When a training process in a multilayer perceptron falls into a local minimum or stalls in a flat region, the proposed DCL scheme is applied to divide the current training data region into two easier to be learned regions. The learning process continues ...
متن کاملComparative Analysis of Neural Networks and Statistical Approaches to Remote Sensing Image Classification
This paper examines different approaches to remote sensing images classification. Included in the study are statistical approach, namely Gaussian maximum likelihood classifier, and two different neural networks paradigms: multilayer perceptron trained with EDBD algorithm, and ARTMAP neural network. These classification methods are compared on data acquired from Landsat-7 satellite. Experimental...
متن کاملModularity - a Concept for New Neural Network Architectures
This paper focuses on the powerful concept of modularity. It is descried how this concept is deployed in natural neural networks on an architectural as well as on a functional level. Furthermore different approaches for modular neural networks are discussed. Based on this a two layer modular neural system is introduced. The basic building blocks of the architecture are multilayer Perceptrons (M...
متن کامل